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WHAT IS CLAIMED IS: 

1. A computer readable medium including instructions readable by 
5 a computer which, when implemented, cause the computer to handle 
information by performing steps comprising: 

receiving data over a network indicative of input at a client 
device and an indication of a grammar to be used with 
the data indicative of the input to perform recognition; 
10 and 

G3 sending data indicative of recognition results for the data 

yj indicative of the input to a remote location on the 

jjj network. 

iM : 2 . The computer readable medium of claim 1 wherein the indication 
^ provides a reference to a location of the grammar. 

JJf 3 . The computer readable medium of claim 1 wherein the 
□ indication includes a reference to a language for recognition. 
20 

4 . The computer readable medium of claim 1 wherein the markup 
language comprises one of HTML, XHTML, cHTML, XML and WML. 

5 . The computer readable medium of claim 1 wherein the markup 
25 language comprises a scripting language. 

6 . The computer readable medium of claim 1 wherein the markup 
language comprises synchronized multimedia markup language. 

30 7. The computer readable medium of claim 1 wherein the recognizer 
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comprises a speech recognizer and the grammar relates to speech 
recognition. 

8. The computer readable medium of claim 1 wherein the recognizer 
comprises a handwriting recognizer and the grrammar relates to 
handwriting recognition. 

9. The computer readable medium of claim 1 wherein the recognizer 
comprises a gesture recognizer and the grammar relates to gesture 
recognition. 

10. The computer readable medium of claim 1 wherein the recognizer 
comprises a visual recognizer and the grammar relates to vision 
recognition. 

11. A method for speech recognition in a client/server network, 
the method comprising: 

receiving data over a network indicative of input speech and 
an indication of a grammar to be used with the data 
indicative of input to perform recognition; 

processing the data using the grammar with a recognizer to 
obtain recognition results; and 

sending the recognition results for the data indicative of 
the input to a remote location on the network. 

12. The method of claim 11 wherein the indication provides a 
reference to a location of the grammar. 

13 . The method of claim 11 wherein the indication includes a 
reference to a language for recognition. 
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14. The method of claim 11 and further comprising providing a 
prompt to the remote location. 

5 15. The method of claim 14 wherein providing a prompt comprises 
converting text data to speech data and providing the speech data 
to the remote location. 

16. A computer readable medium having a markup language for 
XD execution on a client device in a client/server system, the markup 
M3 language comprising instructions to unify at least one of 
ff| recognition-related events, GUI events and telephony events on 

non-display, voice input based client device and a multimodal 
fjj based client for a web server interacting with each of the client 
f5 devices. 

47 

fjj 17. The computer readable medium of claim 16 wherein the markup 
;f language comprises one of HTML, XHTML, cHTML, XML and WML. 

E_ J! 

20 18. The computer readable medium of claim 16 wherein the markup 
language comprises a scripting language. 

19. The computer readable medium of claim 16 wherein the markup 
language comprises synchronized multimedia markup language. 

25 



